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Abstract 

Population protocols have been introduced by Angluin et al. as a model of 
networks consisting of very limited mobile agents that interact in pairs but 
with no control over their own movement. A collection of anonymous agents, 
modeled by finite automata, interact pairwise according to some rules that 
update their states. 

The model has been considered as a computational model in several pa- 
pers. Input values are initially distributed among the agents, and the agents 
must eventually converge to the the correct output. Predicates on the initial 
configurations that can be computed by such protocols have been character- 
ized under various hypotheses. The model has initially been motivated by 
sensor-networks, but it can be seen more generally as a model of networks 
of anonymous agents interacting pairwise. This includes sensor networks, 
ad-hoc networks, or models from chemistry. 

In an orthogonal way, several distributed systems have been termed in 
literature as being realizations of games in the sense of game theory. In 
this paper, we investigate under which conditions population protocols, or 
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more generally pairwise interaction rules, can be considered as the result of a 
symmetric game. We prove that not all rules can be considered as symmetric 
games. We characterize the computational power of symmetric games. We 
prove that they have very limited power: they can count until 2, compute 
majority, but they can not even count until 3. 

As a side effect of our study, we also prove that any population protocol 
can be simulated by a symmetric one (but not necessarily a game). 

Key words: Population Protocols, Computation Theory, Distributed 
Computing, Algorithmic Game Theory 



1. Introduction 

The computational power of networks of anonymous resource-limited mo- 
bile agents has been investigated recently. 

In particular, Angluin et al. proposed in [2] a model of distributed compu- 
tations. In this model, called population protocols, finitely many finite-state 
agents interact in pairs chosen by an adversary. Each interaction has the 
effect of updating the state of the two agents according to a joint transition 
function. 

A protocol is said to (stably) compute a predicate on the initial states of 
the agents if, in any fair execution, after finitely many interactions, all agents 
reach a common output that corresponds to the value of the predicate. 

The model was originally proposed to model computations realized by 
sensor networks in which passive agents are carried along by other entities. 



The canonical example of [2J corresponds to sensors attached to a flock of 
birds and that must be programmed to check some global properties, like 
determining whether more than 5% of the population has elevated temper- 
ature. Motivating scenarios also include models of the propagation of trust 



Much of the work so far on population protocols has concentrated on 
characterizing which predicates on the initial states can be computed in dif- 
ferent variants of the model and under various assumptions. In particular, 
the predicates computable by the unrestricted population protocols from 0] 
have been characterized as being precisely the semi-linear predicates, that is 
those predicates on counts of input agents definable in first-order Presburger 
arithmetic jiof . Semi-linearity was shown to be sufficient in 0] and necessary 
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Variants considered so far include restriction to one-way communications, 
restriction to particular interaction graphs, to random interactions, with pos- 
sibly various kind of failures of agents. Solutions to classical problems of 
distributed algorithmics have also been considered in this model. Refer to 
[3] for a survey and a complete discussion. 

The population protocol model shares many features with other models 
already considered in the literature. In particular, models of pairwise interac- 
tions have been used to study the propagation of diseases 14 . or rumors [gj]. 



In chemistry, the chemical master equation has been justified using (stochas- 
tic) pairwise interactions between the finitely many molecules (l7l . Il3j |. In 
that sense, the model of population protocols may be considered as funda- 
mental in several fields of study, since it appears as soon as anonymous agents 
interact pairwise. 

In an orthogonal way, pairwise interactions between finite-state agents are 
sometimes motivated by the study of the dynamics of particular two-player 



games from game theory. For example, paper [10| considers the dynamics 
of the so-called PAVLOV behavior in the iterated prisoner lemma. Several 
results about the time of con verg ence of this particular dynamics towards the 



stable state can be found in [lOj, and [111], for rings, and complete graphs. 



The purpose of this article is to better understand whether and when 
pairwise interactions, and hence population protocols, can be considered as 
the result of a game. We want to understand if restricting to rules that come 
from a symmetric game is a limitation, and in particular whether restricting 
to rules that can be termed PAVLOV in the spirit of [l0| is a limitation. We 
do so by giving solutions to several basic problems using rules of interactions 
associated to a symmetric game, and by characterizing they power: We prove 
that they can count until 2, they can compute MAJORITY , but they can 
not even count until 3. 

As such protocols must also be symmetric, we are also discussing whether 
restricting to symmetric rules in population protocols is a limitation. We 
prove that any population protocol can be simulated by a symmetric one 
(but not necessarily a game). 

In Section [2, we briefly recall population protocols. In Section [3j we recall 
some basics from game theory. In Section HI we discuss how a game can be 
turned into a dynamics, and introduce the notion of Pavlovian population 
protocol. In Section [5] we prove that any symmetric deterministic 2-states 
population protocol is Pavlovian, and that the problem of computing the OR, 
AND, as well as the leader election and majority problem admit Pavlovian 



3 



solutions. We then characterize there power by proving that they can count 
until 2, but they can not count until 3 in Section [61 We prove that symmet- 
ric population protocols, unlike the restricted class of Pavlovian population 
protocols can compute all semi-linear predicate in Section [7J 

Related work. Population protocols have been introduced in [2J, and proved 
to compute all semi-linear predicates. They have been proved not to be able 
to compute more in 0]. Various restrictions on the initial model have been 
considered up to now. An (almost) up to date survey can be found in p|. 

Variants include discussions about the influence of removing the assump- 
tion of two-way interaction: One-way interaction models include variants 
where agents communicate by anonymous message-passing, with immediate 
delivery or delayed delivery, or where agents can record it has sent a message, 
or queue incoming messages [if. However, as far as we know, the constraint 
of restricting to symmetric rules has not been yet explicitly considered, nor 
restricting to rules that correspond to games in the population protocol lit- 
erature. 

More generally, population protocols arise as soon as populations of anony- 
mous agents interact in pairs. Our original motivation was to consider rules 
corresponding to two-players games, and population protocols arose quite 
incidentally. The main advantage of the |2j settings is that it provides a 
clear understanding of what is called a computation by the model. Many 
distributed systems have been described as the result of games, but as far as 
we know there has not been attempts to characterize what can be computed 
by games in the spirit of this computational model. 

In this paper, we turn two players games into dynamics over agents, by 



considering PAVLOV behavior. This is inspired by 10|, [ill, [16] that con- 
sider the dynamics of a particular set of rules termed the PAVLOV behav- 
ior in the iterated prisoner lemma. The PAVLOV behavior is sometimes 
also termed WIN-STAY, LOSE-SHIFT 0, fl. Notice, that we extended 
it from two-strategies two-players games to n-strategies two-players games, 
whereas above references only talk about two-strategies two-players games, 
and mostly of the iterated prisoner lemma. 

This is clearly not the only way to associate a dynamic to a game. They 
are several famous classical approaches: The first consists in repeating games: 
see for example Il9l. [6_f. The second in using models from evolutionary game 
theory: refer to [la . [2l| for a presentation of this latter approach. The ap- 
proach considered here falls in method that consider dynamics obtained by 
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selecting at each step some players and let them play a fixed game. Alter- 
natives to PAVLOV behavior could include MYOPIC dynamics (at each 
step each player chooses the best response to previously played strategy by 
its adversary), or the well-known and studied FICTIOUS — PLAYER dy- 
namics (at each step each player chooses the best response to the statistics 



of the past history of strategies played by its adversary). We refer to [12 
for a presentation of results known about the properties of the obtained dy- 
namics according to the properties of the underlying game. This is clearly 
non-exhaustive, and we refer to \^ for an incredible zoology of possible be- 
haviors for the particular iterated prisoner lemma game, with discussions of 
their compared merits in experimental tournaments. 

We obtain a characterization of the power of Pavlovian population proto- 
cols in terms of closure properties that show that they can count until 2, but 
not until 3. Notice that several variants of (one-way) population protocols 
have been characterized in [lj in a COUNTk hierarchy. The class obtained 
here seems close to the COUNT 2 level of this latter hierarchy [l|. However, 
on one hand, this is not exactly this class (for example MAJORITY is com- 
putable but not in the COUNT 2 level), and on the other hand, as no class 
there is formally proved to correspond to COUNT2, this shows that the class 
considered here is different, and not reducible to the variants of [l|. 

Notice that a preliminary version of this article has been presented in 
Complexity of Simple Programs CSP'08. Compared to this conference ver- 
sion, we simplified some constructions, we added a few protocols, we extended 
deeply related work discussions, and mainly, we solved the statements con- 
jectured there: we provide here a characterization of the power of Pavlovian 
population protocols, whereas it was open at the time of the presentation of 
this preliminary version. 



2. Population Protocols 

A protocol 0, 0] is given by (Q, E, l, u, 5) with the following components. 
Q is a finite set of states. E is a finite set of input symbols. 1 : £ — > Q 
is the initial state mapping, and u> : Q — > {0, 1} is the individual output 
function. 5 C Q A is a joint transition relation that describes how pairs of 
agents can interact. Relation S is sometimes described by listing all possi- 
ble interactions using the notation (91,52) — * {^11^7)1 or even the notation 
<7i<72 — ► q'iq'21 f° r (<?i 1 ?2, Qii q'2) G <5 (with the convention that (qi, q 2 ) — ► ((ft, q 2 ) 
when no rule is specified with (qi,q 2 ) in the left-hand side). The protocol 
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is termed deterministic if for all pairs (91,^2) there is only one pair (q[,q 2 ) 
with (q 1 , q 2 ) — > (q[, q' 2 ). In that case, we write Si(qi, q 2 ) for the unique q[ and 
$2(91, 92) for the unique g 2 - 

Notice that, in general, rules can be non-symmetric: if (qi, q 2 ) — > (q[, q 2 ), 
it does not necessarily follow that (?2,?i) — > (?2)?i)- 

Computations of a protocol proceed in the following way. The computa- 
tion takes place among n agents, where n > 2. A configuration of the system 
can be described by a vector of all the agents' states. The state of each 
agent is an element of Q. Because agents with the same states are indistin- 
guishable, each configuration can be summarized as an unordered multiset 
of states, and hence of elements of Q. 

Each agent is given initially some input value from E: Each agent's initial 
state is determined by applying 1 to its input value. This determines the 
initial configuration of the population. 

An execution of a protocol proceeds from the initial configuration by 
interactions between pairs of agents. Suppose that two agents in state q\ 
and q 2 meet and have an interaction. They can change into state q[ and q 2 if 
{qi , q2,q[, q 2 ) is i n the transition relation 6. If C and C are two configurations, 
we write C — ■> C if C can be obtained from C by a single interaction of two 
agents: this means that C contains two states q\ and q 2 and C is obtained by 
replacing qi and q 2 by q[ and q' 2 in C, where (qi, q2,q[, q 2 ) £ S. An execution 
of the protocol is an infinite sequence of configurations Co, C±, C 2 , • • • , where 
Co is an initial configuration and C — > C + i for all « > 0. An execution is 
fair if for all configurations C that appear infinitely often in the execution, 
if C — > C for some configuration C, then C appears infinitely often in the 
execution. 

At any point during an execution, each agent's state determines its out- 
put at that time. If the agent is in state q, its output value is u(q). The 
configuration output is (respectively 1) if all the individual outputs are 
(respectively 1). If the individual outputs are mixed 0s and Is then the 
output of the configuration is undefined. 

Let p be a predicate over multisets of elements of S. Predicate p can 
be considered as a function whose range is {0, 1} and whose domain is the 
collection of these multisets. The predicate is said to be computed by the 
protocol if, for every multiset /, and every fair execution that starts from 
the initial configuration corresponding to /, the output value of every agent 
eventually stabilizes to p(I) . 

Multisets of elements of £ are in clear bijection with elements of N' s ': a 
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multiset over £ can be identified by a vector of |S| components, where each 
component represents the multiplicity of the corresponding element of E in 
this multiset. It follows that predicates can also be considered as functions 
whose range is {0, 1} and whose domain is N' S L 
The following was then proved in @, S] • 

Theorem 1 (@, S])- A predicate is computable in the population protocol 
model if and only if it is semilinear. 

Recall that semilinear sets are known to correspond to predicates on 
counts of input agents definable in first-order Presburger arithmetic [20j . 

We will use the following notation as in [lj]: the set of all functions from 
a set X to a set Y is denoted by Y x . Let S be a finite non-empty set. For 
all f,g G we define the usual vector space operations 



Abusing notation as in [1], we will write a for the function o~(o~') — [a — 
a'], for all a' G S, where [condition] is 1 if condition is true, otherwise. 

3. Game Theory 

We now recall the simplest concepts from Game Theory. We focus on 
non-cooperative games, with complete information, in extensive form. 

The simplest game is made up of two players, called I and II, with a 
finite set of options, called pure strategies, Strat(I) and Strat(II). Denote 
by Aij (respectively: B it j) the score for player I (resp. II) when / uses 
strategy i G Strat(I) and 77 uses strategy j G Strat(II). 

The scores are given bjnxm matrices A and B, where n and m are the 
cardinality of Strat(I) and Strat(II). The game is termed symmetric if A 
is the transpose of B: this implies that n = m, and we can assume without 
loss of generality that Strat(I) = Strat(II). 

In this paper, we will restrict to symmetric games. 

Example 1 (Prisoner's dilemma). The case where A and B are the following 
matrices 



(f-g)(°) 

(cf)(a) 

U-g){°) 



f(cr)+g(a) 
f{<r)-g{a) 
cf{ci) 



for all a G S 
for all a G S 
for all a G S, c G R 
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R T \ 
S P J 

with T > R > P > S and 2R > T + S, is called the prisoner's dilemma. We 
denote by C (for cooperation) the first pure strategy, and by D (for defection) 
the second pure strategy of each player. 

As the game is symmetric, matrix A and B can also be denoted by: 

Opponent 



Player 





C 


D 


c 


R 


S 


D 


T 


P 



A strategy x E Strat(I) is said to be a best response to strategy y E 
Strat(II), denoted by x E BR(y) if 

A z ,y < A x , y (1) 

for all strategies z E Strat(I). 

A pair (x,y) is a (pure) Nash equilibrium if x E BR(y) and y E BR(x). 
A pure Nash equilibrium does not always exist. 

In other words, two strategies (x, y) form a Nash equilibrium if in that 
state neither of the players has a unilateral interest to deviate from it. 

Example 2. On the example of the prisoner's dilemma, BR{y) = D for all 
y, and BR(x) = D for all x. So (D, D) is the unique Nash equilibrium, and 
it is pure. In it, each player has score P. The well-known paradox is that 
if they had played (C, C) (cooperation) they would have had score R, that is 
more. The social optimum {C,C), is different from the equilibrium that is 
reached by rational players (D, D), since in any other state, each player fears 
that the adversary plays C . 

We will also introduce the following definition: Given some strategy x' E 
Strat(I), a strategy x E Strat(I) is said to be a best response to strategy 
y E Strat(II) among those different from x' : denoted by x E BR^ x /(y) if 

A ZjV < A X:V (2) 

for all strategy z E Strat(I), z ^ x' . 

Of course, the roles of II and I can be inverted in the previous definition. 

8 



There are two main approaches to discuss dynamics of games. The first 



consists in repeating games 19|, [6|. The second in using models from evo 



lutionary game theory. Refer to [15|, [2l[ for a presentation of this latter 
approach. 

Repeating Games. Repeating k times a game, is equivalent to extending the 
space of choices into Strat(I) k and Strat(II) k : player / (respectively II) 
chooses his or her action x{t) G Strat(I), (resp. y{t) G Strat(II)) at time 
t for t = 1,2,- ■■ , k. Hence, this is equivalent to a two-player game with 
respectively n k and m k choices for players. 

To avoid confusion, we will call actions the choices x(t),y(t) of each player 
at a given time, and strategies the sequences X = x(l), ■ ■ ■ ,x(k) and Y = 
y(l), ■ ■ ■ , y(k), that is to say the strategies for the global game. 

If the game is repeated an infinite number of times, a strategy becomes a 
function from integers to the set of actions, and the game is still equivalent 
to a two-player game^. 

Behaviors. In practice, player / (respectively II) has to solve the following 
problem at each time t: given the history of the game up to now, that is to 
say 

X t - 1 = x(l),-'- ,x(t-l) 

and 

Y t _ 1 = y(l),--- ,y{t-l) 

what should I (resp. II) play at time tl In other words, how to choose 
x(t) G Strat(I)? (resp. y(t) G Strat(II)?) 

Is is natural to suppose that this is given by some behavior rules: 

X(t) = Y t _ x ), 

y(t) = g(X t ^,Y t ^) 
for some particular functions / and g. 



but whose matrices are infinite. 
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The Specific Case of the Prisoner's Lemma. The question of the best behav- 
ior rule to use for the prisoner lemma gave birth to an important literature. 
In particular, after the book [5J, that describes the results of tournaments of 
behavior rules for the iterated prisoner lemma, and that argues that there 
exists a best behavior rule called TIT — FOR — TAT. This consists in co- 
operating at the first step, and then do the same thing as the adversary at 
subsequent times. 

A lot of other behaviors, most of them with very picturesque names have 
been proposed and studied: see for example 0] . 

Among possible behaviors there is PAVLOV behavior: in the iterated 
prisoner lemma, a player cooperates if and only if both players opted for the 
same alternative in the previous move. This name 0, [ly, Eq] stems from the 
fact that this strategy embodies an almost reflex-like response to the payoff: 
it repeats its former move if it was rewarded by R or T points, but switches 



behavior if it was punished by receiving only P or S points. Refer to 18] for 
some study of this strategy in the spirit of Axelrod's tournaments. 

The PAVLOV behavior can also be termed WIN-STAY, LOSE-SHLFT 
since if the play on the previous round results in a success, then the agent 
plays the same strategy on the next round. Alternatively, if the play resulted 
in a failure the agent switches to another action j^, lj| . 



Going From 2 Players to N Players. PAVLOV behavior is Markovian: a 
behavior / is Markovian, if f(Xt-i, lt-i) depends only on x(t— 1) and y(t— 1). 

From such a behavior, it is easy to obtain a distributed dynamic. For 
example, let's follow 1(|, for the prisoner's dilemma. 



Suppose that we have a connected graph G = (V,E), with N vertices. 
The vertices correspond to players. An instantaneous configuration of the 
system is given by an element of {C, D} N , that is to say by the state C or 
D of each vertex. Hence, there are 2^ configurations. 

At each time t, one chooses randomly and uniformly one edge of the 
graph. At this moment, players i and j play the prisoner dilemma with the 
PAVLOV behavior. It is easy to see that this corresponds to executing the 
following rules: 



(3) 



cc - 


-> CC 


CD - 


-> DD 


DC - 


-> DD 


DD - 


-> CC. 
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What is the final state reached by the system? The underlying model 
is a very large Markov chain with 2 N states. The state E* = {C} N is 
absorbing. If the graph G does not have any isolated vertex, this is the 
unique absorbing state, and there exists a sequence of transformations that 
transforms any state E into this state E*. As a consequence, from well-known 
classical results in Markov chain theory, whatever the initial configuration is, 
with probability 1, the system will eventually be in state E* Q. The system 
is self-stabilizing. 

Several results about the time of convergence towards this stable state 
can be found in ToJ, and 11], for rings, and complete graphs. 



What is interesting in this example is that it shows how to go from a 
game, and a behavior to a distributed dynamic on a graph, and in particular 
to a population protocol when the graph is a complete graph. 



4. From Games To Population Protocols 

In the spirit of the previous discussion, to any symmetric game, we can 
associate a population protocol as follows. 

Definition 1 (Associating a Protocol to a Game). Assume a symmetric 
two-player game is given. Let A be some threshold. 

The protocol associated to the game is a population protocol whose set of 
states is Q, where Q = Strat(I) = Strat(II) is the set of strategies of the 
game, and whose transition rules 5 are given as follows: 

(QuQ2,q 1 ,q' 2 ) € 5 

where 

• q[ — 0.1 when M qim > A 

• q[e BRjL qi (q 2 ) when M qxm < A 
and 

• Q.2 = <?2 when M q2<qi > A 

• q' 2 E BR 7 L q2 (q 1 ) when M q2m < A, 
where M is the matrix of the game. 
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Remark 1. By subtracting A to each entry of the matrix M, we can assume 
without loss of generality that A = 0. We will do so from now on. 

Definition 2 (Pavlovian Population Protocol). A population protocol is Pavlo- 
vian if it can be obtained from a game as above. 

Remark 2. Clearly a Pavlovian population protocol must be symmetric: in- 
deed, whenever (q 1 , q 2 , q[, q 2 ) G 5, one has (q 2 , qi, q' 2 , Qi) £ S. 

5. Some Specific Pavlovian Protocols 

We now discuss whether assuming protocols Pavlovian is a restriction. 
We start by an easy consideration. 

Theorem 2. Any symmetric deterministic 2-states population protocol is 
Pavlovian. 

Proof. Consider a deterministic symmetric 2-states population protocol. Note 
Q = {+, — } its set of states. Its transition function can be written as follows: 



for some a ++ , a 

This corresponds to the symmetric game given by the following pay-off 
matrix M 





Opponent 
+ 



Player 



+ P+- 
- P-+ P- 



where for all qi,q 2 G {+,—}, 



• fiq\qi = ~ 1 otherwise. 



□ 
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Unfortunately, not all rules correspond to a game. 

Proposition 1. Some symmetric population protocols are not Pavlovian. 

Proof. Consider for example a deterministic 3-states population protocol 
with set of states Q = {qo,Qi,Q2} and a joint transition function 6 such 

that 5i(g , go) = 9i, <$i(gi, go) = g2 , £1(92, go) = go- 
Assume by contradiction that there exists a 2-player game corresponding 
to this 3-states population protocol. Consider its payoff matrix M. Let 
M(q ,q ) = A), M(q u q ) = , M(g 2 ,g ) = f3 2 . We must have (3 > A = 
0,/3i > A = since all agents that interact with an agent in state go must 
change their state. Now, since go changes to qi, q\ must be a strictly better 
response to go than g 2 : hence, we must have (3\ > f3 2 . In a similar way, since 
gi changes to q 2 , we must have f3 2 > A) , and since q 2 changes to go, we must 
have fa > f3\. From f3\> f3 2 > (3q we reach a contradiction. □ 

This indeed motivates the following study, where we discuss which prob- 
lems admit a Pavlovian solution. 

5.1. Basic Protocols 

Proposition 2. There is a Pavlovian protocol that computes the logical OR 
(resp. AND) of input bits. 

Proof. Consider the following protocol to compute OR, 



01 - 


-> 11 


10 - 


■+ 11 


00 - 


-> 00 


11 - 


■+ 11 



(5) 



and the following protocol to compute AND, 

01 -»• 00 

10 -> 00 
00 -> 00 

11 -> 11 

Since they are both deterministic 2-states population 
Pavlovian. 



(6) 

protocols, they are 
□ 
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Remark 3. Notice that OR (respectively AND) protocol corresponds to the 
predicate [x.O > 1] (resp. [x.O = 0]), where x is the input. A simple change 
of notation yields a protocol to compute [x.a > 1] and [x.a = 0] for any input 
symbol a. 

Remark 4. All previous protocols are "naturally broadcasting" i.e., eventu- 
ally all agents agree on some (the correct) value. With previous definitions 
(which are the classical ones for population protocols), the following protocol 
does not compute the XOR or input bits, or equivalently does not compute 
predicate [x.l = 1 (mod 2)]. 



01 - 


-> 01 


10 - 


■+ 10 


00 - 


■+ 00 


11 - 


■+ 00 



(7) 



Indeed, the answer is not eventually known by all the agents. It computes 
the XOR in a weaker form i.e., eventually, all agents will be in state 0, if 
the XOR of input bits is ; or eventually only one agent will be in state 1, 
if the XOR of input bits is 1. 

Proposition 3. There is a Pavlovian protocol that computes the threshold 
predicate [x.a > 2], which is true when there are at least 2 occurrences of 
input symbol o in the input x. 

Proof. The following protocol is a solution taking 

• £ = {0,a}, Q = {0,a,2}, 

• u(0) = u(a) = 0, 

• cu(2) = 1. 



00 - 

0(7 

aO 
02 - 
20 - 
aa 
a2 - 
2a - 
22 - 



00 
0a 
aO 
22 
22 
22 
22 
22 
22 



(8) 
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Indeed, if there is at least two a, then by fairness and by the rule number 
6, they will ultimately be changed into two 2s. Then 2s will turn all other 
agents into 2s. Now, this is the only way to create a 2. 

This is a Pavlovian protocol since it corresponds to the following payoff 
matrix. 

Opponent 
a 2 

0-1 

-1 -1 

1 1 1 

□ 

Hence, Pavlovian population protocols can count until 2. We will prove 
later on that they can not count until 3. 

5.2. Leader Election 

The classical solution [2| to the leader election problem (starting from a 
configuration with > 1 leaders, eventually exactly one leader survives) is the 
following: 



LL - 


-> LN 


LN - 


-> LN 


NL - 


-> NL 


NN - 


-> NN 



(9) 



Notice that we use the terminology "leader election" as in [2| for this 
protocol, but that it may be considered more as a "mutual exclusion" protocol. 
Unfortunately, this protocol is non-symmetric, and hence non- Pavlovian. 

Remark 5. Actually, the problem is with the first rule, since one wants two 
leaders to become only one. If the two leaders are identical, this is clearly 
problematic with symmetric rules. 

However, the leader election problem can actually be solved by a Pavlo- 
vian protocol, at the price of a less trivial protocol. 





Player 

2 
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Proposition 4. The following Pavlovian protocol solves the leader election 
problem, as soon as the population is of size > 3. 



L\L 2 

LiN 

L 2 N 

NN 

L 2 Li 

iVLi 

NL 2 

UL X 

L 2 L 2 



LiN 
NL 2 

NN 

NLi 

L 2 N 

^N 

L 2 L 2 

L X L X 



(10) 



Proof. Indeed, starting from a configuration containing not only Ns, eventu- 
ally after some time configurations will have exactly one leader, that is one 
agent in state L\ or L 2 . 

Indeed, the first rule and the fifth rule decrease strictly the number of 
leaders whenever there are more than two leaders. Now the other rules, pre- 
serve the number of leaders, and are made such that an L\ can always be 
transformed into an L 2 and vice-versa, and hence are made such that a con- 
figuration where first or fifth rule applies can always be reached whenever 
there are more than two leaders. The fact that it solves the leader elec- 
tion problem then follows from the hypothesis of fairness in the definition of 
computations. 

This is a Pavlovian protocol, since it corresponds to the following payoff 
matrix. 



Opponent 
L 1 L 2 N 



Player ^ 
N 



-3 -3 
-1 -3 -3 
-2 -3 



□ 

5.3. Majority 

Proposition 5. The majority problem (given some population of input sym- 
bols a and a' , determine whether there are more a than a') can be solved by 
a Pavlovian population protocol. 
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Remark 6. If one prefers, the predicate [x.a > x.cr'], where a and a' are two 
input symbols, and x is the input, is computable by a Pavlovian population 
protocol. 

Proof. We claim that the following protocol outputs 1 if there are more a 
than a' in the initial configuration and otherwise, 



NY 

YN 

Na 

oN 

Ya' 

a'Y 

aa' 

a'a 



YY 

YY 

Ya 

aY 

Na' 

a'N 

NY 

YN 



(11) 



taking 

• Z = {a,a'},Q = {a,a',Y,N}, 

• cu(a) = u(Y) = 1, 

• co(a') = u(N) = 0. 

In this protocol, the states Y and N are "neutral" elements for our pred- 
icate but they should be understood as Yes and No. They are the "answers" 
to the question: are there more 0s than Is. 

This protocol is made such that the numbers of a and a' are preserved 
except when a a meets a a'. In that latter case, the two agents are deleted 
and transformed into a Y and a N. 

If there are initially strictly more a than a', from the fairness condition, 
each a' will be paired with a a and at some point no a' will left. By fairness 
and since there is still at least configuration containing only a and 

Ys will be reached. Since in such a configuration, no rule can modify the 
state of any agent, and since the output is defined and equals to 1 in such a 
configuration, the protocol is correct in this case 

By symmetry, one can show that the protocol outputs if there are 
initially strictly more a' than a. 

Suppose now that initially, there are exactly the same number of a and 
a'. By fairness, there exists a step when no more agents in the state a or a' 
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left. Note that at the moment where the last a is matched with the last a', 
a Y is created. Since this Y can be "broadcasted" over the TVs, in the final 
configuration all agents are in the state Y and thus the output is correct. 

This protocol is Pavlovian, since it corresponds to the following payoff 
matrix. 

Opponent 
N Y a a' 
1 -L -L r~ 
11-1 
-1 
0-10 

□ 

6. Bounds on the Power of Pavlovian Population Protocols 

We proved that predicates [x.a = 0], [x.a > 1], [x.a > 2] can be computed 
by some Pavlovian population protocols, as well as [x.a > x.a']. 

It is clear that the subset of the predicates computable by Pavlovian 
population protocols is closed by negation: just switch the value of the indi- 
vidual output function of a protocol computing a predicate to get a protocol 
computing its negation. 

Notice that, unlike what happens for general population protocols, com- 
posing Pavlovian population protocols into a Pavlovian population protocol 
is not easy. It is not clear whether Pavlovian computable predicates are closed 
by conjunctions: classical constructions for general population protocols can 
not be used directly. 

The power of Pavlovian population protocols is actually rather limited as 
they can count up to 2, but not 3. 

Theorem 3. There is no Pavlovian protocol that computes the threshold 
predicate [x.a > 3], which is true when there are at least 3 occurrences of 
input symbol a in the input x. 

Proof. We will prove this by contradiction. Assume there exists such a Pavlo- 
vian protocol. Without loss of generality we may assume that £ = {0,a} is 
a subset of the set of states Q. 

As the protocol is Pavlovian, and hence symmetric, any rule qq — > q'q", 
is such that q' = q", that is to say of the form qq — > q'q' for all q G Q. 



N 

Player Y 
a 
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Let then consider the sequence of rules such that a a — > g 4 gi — > g 2 g 2 - >■ 
► gfc^fe -»• • • ■ where a, g 4 g 2 , 8s,-,ft6Q. 

Since Q is finite, there exist two distinct integers & and £ such that q k = qe 
and k < £. 

The case & + 1 = £ is not possible. Indeed, we would have the rule 
<lk<lk QkQk- Consider the inputs x 3 and x 4 such that x 3 = {a, a} and 
x 4 = {a, a, a, a}. x$ must be accepted. From x 4 there is a derivation a; 4 — > 
{gi,gi,a,er} -> {qi,qi,qiqi} ^* {qk,qk,qk,qk}- This latter configuration is 
terminal from the above rule. Since x 4 must be accepted, we must have 
u(q k ) = 1. However, from x 3 there is a derivation x 3 — > {g 4 , g 4 } — >* {g^, g^}, 
where the last configuration is also terminal. We reach a contradiction, since 
its output would be co(q k ) = 1, whereas x 3 must be rejected. 

Hence, k + 1 < £, and q k q k — > q k+1 q k+1 q e q e — > g fc g fc . Let T be 

then the set of states T = {qi : k < i < £}. 

Since — > qi + ±qi + i is among the rules, since the protocol is Pavlovian 
with a matrix M, and by definition of Pavlov behavior, we must have qi + x = 
BR^ q .(qi) (with the convention that qi + i is qk). So, BR(qi) can be q i+ i or 

Let then discuss the rules 

w - (12) 

for g^g,- G T. 

There are three possibilities for the value of q[: 

1. g< = qi if M^. > A 

2- 3j = g,, if M mj < A and if g, = BR^qj) 

3- g- = g,+i if M ?i9 . < A and if g j+i = BR^qj) 

In any case, we see that the value of q[ is in T. 

Symmetrically, we have three possibilities for g'-, all of them in T. 

Hence, all rules of the form ffl2|) preserve T: we have q[, q'j G T, as soon 
as g i5 gj G T. 

Consider still then the inputs x 3 and x 4 such that x 3 = {a, a} and 
x 4 = {a, er, a, cr}. From x 4 there is a derivation x 4 — > {q\, qi, a, a} — > 
{gi,gi,gigi} — >* {qk, qk, qk, qk}- From this last configuration, by above re- 
mark, the state of all agents will be in T. As x 4 must be accepted, ultimately 
all agents will be in states that belong to T whose image by a; is 1. Consider 
now x 3 . From x 3 there is a derivation x 3 — > {gi,gi} — >* {gfc,g/c} that then 
will go trough all configurations {qiqi}, for the 4 G T in turn. This can 
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not eventually stabilize to elements whose image by to is 0, as some of the 
elements of T have image 1 by u, and hence £3 is not accepted. This yields 
a contradiction, and hence such a Pavlovian protocol can not exist. □ 

7. The Power of Symmetric Population Protocols 

Pavlovian Population protocols are symmetric. We just proved that they 
have a very limited computational power. However, assuming population 
protocols symmetric (not-necessarily Pavlovian) is not truly a restriction. 

Proposition 6. Any population protocol can be simulated by a symmetric 
population protocol, as soon as the population is of size > 3. 

Before proving this proposition, we state the (immediate) main conse- 
quence. 

Corollary 1. A predicate is computable by a symmetric population protocol 
if and only if it is semilinear. 

Proof. To a population protocol (Q, E, 1, u, S), with Q = {q±, - • • , q n } asso- 
ciate population protocol (Q U Q', E, 1, u, 6') with Q' — {q[, • ■ • , q' n }, ou(q') = 
uj(q) for all q G Q, and for all rules 

qq — > af3 

in 5, the following rules in 5': 

qq' — > af3 
q'q — > (3a 
qq — > q'q' 
^ q'q' -> qq 

Ql -»• q'j 
q'j -> ?7 

7? -»• 7?' 
k l4 -»• 7? 

for all 7 G Q U Q', 7 7^ g, 7 7^ q', and for all pairs of rules 

J gr — > a/5 
^ rg — > <5e 
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with q,r e Q, the following rules in 5': 

qr' — > a(3 
r'q — > (3a 
rq' — > 5e 
gV — > e& 

The obtained population protocol is clearly symmetric. Now the first set 
of rules guarantees that a state in Q can always be converted to its primed 
version in Q' and vice-versa. By fairness, whenever a rule qq — > af3 (re- 
spectively qr — > a/3) can be applied, then the corresponding two first rules 
of the first set of rules (resp. of the second set of rules) can eventually be 
fired after possibly some conversions of states into their primed version or 
vice-versa. □ 
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